Rotating item banks versus restriction of maximum exposure rates in computerized adaptive testing.
نویسندگان
چکیده
If examinees were to know, beforehand, part of the content of a computerized adaptive test, their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy, However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
منابع مشابه
Maximum information stratification method for controlling item exposure in computerized adaptive testing.
The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters ( a ) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rat...
متن کاملComparison of methods for controlling maximum exposure rates in computerized adaptive testing.
This paper has two objectives: (a) to provide a clear description of three methods for controlling the maximum exposure rate in computerized adaptive testing -the Symson-Hetter method, the restricted method, and the item-eligibility method- showing how all three can be interpreted as methods for constructing the variable sub-bank of items from which each examinee receives the items in his or he...
متن کاملContent Balancing in Stratified Computerized Adaptive Testing Designs
For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...
متن کاملImplementing the a-Stratified Method with b Blocking in Computerized Adaptive Testing with the Generalized Partial Credit Model
The purpose of the current study was to generalize the use of the a-stratified method with b blocking (Chang, Qian, & Ying, 2001; denoted STR_B) to computerized adaptive testing (CAT) with the generalized partial credit model (Muraki, 1992). Chang et al. (2001) showed that STR_B performs well in reducing highly discriminating items' exposure rates and increasing lower a items' usage while maint...
متن کاملConstraining Item Exposure in Computerized Adaptive Testing with Shadow Tests
Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests. The method resembles Sympson and Hetter's (1985) method of item-exposure control in that the decisions to impose the constraints are probabilistic. However, the method does not require time-consuming simulation studies to set values for co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- The Spanish journal of psychology
دوره 11 2 شماره
صفحات -
تاریخ انتشار 2008